Static Gesture Recognizer Using Hybrid Neural Network
نویسندگان
چکیده
The main objective of this paper proposes an Embedded System employing Hybrid Neural Network (NN) for an Efficient Static Recognizer. The Hybrid Neural Network consists of Active Contour Model (ACM) and Convolutional Neural Network (CNN) in which the input data of hand sign is pre-processed and segmented using ACM and that image is feed forward to CNN classifier to classify the image for free-air hand gesture recognition without the use of hand gloves or sensors to offer a more efficient way of gesture segmentation as gesture boundaries. The system is developed to detect the hand signs in American Sign Language (ASL), and its convenience will be verified through simulations and the input is converted from sign to text and vice versa. The image is described in four languages such as English, Tamil, Hindi and Telugu and there is a need in designing an efficient human-computer interface. The possibility of the system in which the hand shapes or poses of static gestures is being captured by a camera, to improve the way of conveying information’s between the deaf and the non-deaf.
منابع مشابه
Neural Network Performance Analysis for Real Time Hand Gesture Tracking Based on Hu Moment and Hybrid Features
This paper presents a comparison study between the multilayer perceptron (MLP) and radial basis function (RBF) neural networks with supervised learning and back propagation algorithm to track hand gestures. Both networks have two output classes which are hand and face. Skin is detected by a regional based algorithm in the image, and then networks are applied on video sequences frame by frame in...
متن کاملImproved Hidden Markov Model Speech Recognition Using Radial Basis Function Networks
A high performance speaker-independent isolated-word hybrid speech recognizer was developed which combines Hidden Markov Models (HMMs) and Radial Basis Function (RBF) neural networks. In recognition experiments using a speaker-independent E-set database, the hybrid recognizer had an error rate of 11.5% compared to 15.7% for the robust unimodal Gaussian HMM recognizer upon which the hybrid syste...
متن کاملImproved Hidden Markov Models Speech Recognition Using Radial Basis Function Networks
A high performance speaker-independent isolated-word hybrid speech recognizer was developed which combines Hidden Markov Models (HMMs) and Radial Basis Function (RBF) neural networks. In recognition experiments using a speaker-independent E-set database, the hybrid recognizer had an error rate of 11.5% compared to 15.7% for the robust unimodal Gaussian HMM recognizer upon which the hybrid syste...
متن کاملPseudo-segment based speech recognition using neural recurrent whole-word recognizers
In this paprr, we dvscribe d recurrent neural network based, isolated word speech recognizer. 'The recognizer uses 2 MLP's. A f i s t , static MLP is used for classification of frames in phonemes. Next, a time compression step is applied. The resulting pseudo-segments are then used as inputs for a second, dynamic MLP that integrates the information over time to decide the current word. We apply...
متن کاملTowards Natural Language Understanding using Multimodal Deep Learning
This thesis describes how multimodal sensor data from a 3D sensor and microphone array can be processed with deep neural networks such that its fusion, the trained neural network, is a) more robust to noise, b) outperforms unimodal recognition and c) enhances unimodal recognition in absence of multimodal data. We built a framework for a complete workflow to experiment with multimodal sensor dat...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2017